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@ A pipelined processor uses pipe control and register translation to maxmiize instruction flow through, 
in an exemplary embodhnent, the executton pipelines of a superscalar, superpipelined microprocessor 
compatilrfe witti the x86 instruction set architecture. The pipe control logic simultaneously issues 
instructions into X and Y pipelines without regard to data dependencies between those instructions 
issued instructions, and in particular witliout regard to read-atler-write dependencies. Pipe switching 
altows instructions to be issued into either execution pipeline so as to minimize stalls due to data 
dependencies between instructions. Instnrction flow is controlled independently for each pipeline, with 
data dependencies between instructions t>eing monitored at each stage of a pipeline. A register 
translation unit mplements register renanr^ng to eliminate write-afler-read and wiite-after-read depen- 
dencies, and data forwarding (both operand forwarding and result forwarding) to eliminate read- 
after-write dependencies through the pipelines is controlled independently. The register translation unit 
contnjis the mapping of the eight x86 logical registers into 32 physical registers, including maintaining 
for each physical register status as to availability, logical register allocation, and write pending - 
allocations of physical registers are based on operand size. Instructions are allowed to proceed to 
execution once it has been determined that tiie instnjiction can no longer cause an exception, 
permitting out-of-order completion. Checkpoint and Exception registers in the register translation unit 
support speculative execution, pennitting pipeline recovery and repair after an instnjction exception, 
branch misprediction , or floating point error. A microcontrd unit provides independent microinstruc- 
tion flows for both pipelines, enabling, for selected instnjction : (a) both execution stages to be used to 
execute the same instructnn, and (b) control of the register translation unit. 
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Cro88 Rafarance to Relatod Applications 

This application is related to U.S. Ser. No. 08/136,654. (Atty Docket No. CX00186), enttaed "Control of 
Data for Speculative Executfon and Exception handing in a Microprocessor with Write Buffer* by Garibay et 
al, filed concunrently herewith. U.S. Ser. No. 08/138,783, (Atty Docltet No. CX00180), entitled 'Branch Proc- 
essing Unit" to McMahon, filed concurrently herewith, U.S. Ser. No. 08/138.781, (Atty Docket No. CX00181), 
entitled "Speculative Execution in a Pipelined Processor" to Bluhm, filed concun-ently herewith, and U.S. Ser. 
No. 08/138,855, (Atty Docket No. CX00167) to Hervin et al. entitled "Microprocessor Having Single Oock In- 
struction Decode Architecture", filed concurrently herewith, all of which are Incorporated by reference herein. 

Background of the invention 

1. Technical Field. 

This invention relates in general to microprocessors and more particularly to a pipelined, superscalar mi- 
croprocessor architecture. 

2. Related Art 

In the design of a micioprocessor. instnictton throughput, l.e., the number of instructions executed per sec- 
ond, is of primary importance. The number of instructions executed per second may be increased by various 
means. The most straightforward technique for increasing instructimi throughput is by increasing frequency 
at which the microprocessor operates, increased operating frequency, however, is limited by tebrication tech- 
niques and also results in the generation of excess heat 

Thus, modern day microprocessor designs are focusing on Increasing the instruction thtxHighput by using 
design techniques which increase the average number of Instructions executed per clock cyde period. One 
such technique for ina-easing instruction throughput is "pipelining." Pipelining techniques segment each in- 
struction flowing through the microprocessor into several portions, each of which can be handled by a separate 
stage in the pipeline, Plp^ining increases the speed of a microprocessor by overlapping multiple instructions 
in execution. Fot example, if each instruction could be executed in six stages, and each stage required one 
clock cyde to perform its function, six separate instructions could be simultaneously executed (each executing 
in a separate stage of the pipeline) such that one instruction was completed on each dock cyde. In this ideal 
scenario, the pipelined architecture would have an instruction throughput which was six times greater than 
the non-pipelined architecture, which could complete one instruction every six dock cydes. 

A second technique for inaeasir^ the speed of a microprocessor is by designing it to be a "superscalar." 
In a superscalar architecture, more than one instruction is issued per dock cyde. If no instructions were de- 
pendent upon other instructions in the flow, the increase in instruction throughput would be proporttonal to 
the degree of scaleabiiity. Thus, if an architecture were superscalar to degree 2 (meaning that two instructions 
issued upon each dock cyde), then the instruction throughput in the machine would double. 

A mferoprocessor may be both superpipelined (an instruction pipeline with many stages is r^erred to as 
"supenJip^ined") and superscalar to achieve a high instruction throughput However, the operation of sudi a 
system in practice is far from the ideal situation where each instrucfion can be neatly executed in a given num- 
ber of pipe stages and where the execution of instructtons is not intwdependent In actual operation, instruc- 
tions have varying resource requbements, thus creating inten-uptions in the flow of instructions through the 
pipeline. Further, the instructions typically have interdependondes; for example, an instruction which reads 
the value of a register is dependent on a previous instruction which writes the value to that same register - the 
second instruction cannot execute until the first instruction has completed its vin-ite to the register. 

Consequently, while supeipipelining and superscalar techniques can increase the throughput of a micro- 
processor, the instruction throughput is highly dependent upon the implementation of the superpipelined, su- 
perscalar architecture. One particular problem is controlling the flow of in^ructlons in the pipeline Increase 
the instruction through put without increasing the frequency of the microprocessor. The efficiency of a super- 
pipelined, superscalar machine Is diminished as dependendes, or other Actors, cause various stages to be 
inactive during operation of the microprocessor. 

Therefore, a need has arisen for a microprocessor architecture with eff ident control of the flow of instruc- 
tions therein. 
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Summary of the Inwntlon 

The invention involves a superscalar, pipelined processor including a plurality of instruction pipelines, eacli 
having a plurality of stages in which instructions issued into a pipeline are processed. 

In one aspect of the inventton. the processor simultaneously issues instructions into multiple pipelines with- 
out regand to data dependencies betvireen such issued instru<aions. Pipe control means detects dependencies 
between instructions in the pipelines, and controls the flow of instructions through the stages of the pipelines 
such that a first instruction in a current stage of one pipeline is not delayed due to a data dependency on a 
second instruction in another pipeline unless the data dependency must be resolved for proper processing of 
the first instruction in such current stage. 

In another aspect of the invention, pipe control means controls instruction flow in the pipelines such that, 
for a given stage, a junior instruction cannot modify the processor state before a senior instruction until after 
the senior instruction can no longer cause an exception. 

In another aspect of the invention, pipe swttching means allows selective switching of instructions between 
the pipelines, ordering instructions in the pipelines in a sequence to feduce dependencies between instruc- 
tions. 

In another aspect of the invention, at least two of the pipelines include an execution stage, and a micro- 
controSer means provides independent microinstruction flows to each execution stage, selectively controlling 
each microinstruction flow such that for sa&Alve instructions, the execution stages are independently con- 
trolled to process a single instruction. 

In anothw aspect of the invention, the pipe control means monitors state information for each stage and 
controls the flow of instructions between stages responsive to the state information, such that an instruction 
in a pipeline can advance from one stage to another independent of the instruction flow in other pipelines. 

In another aspect of the Invention, the pipe control means ^Iminates a dependency between first and sec- 
ond instructions by altering the operand source for one of the instructions. 

In another aspect of the invention, the register translation means maintains processor state information 
defining a set of physical registers that have been mo^ recently allocated to each of the logical registers in 
response to writes to those logical registers. When instructions are issued into a pipeline prior to determining 
whether such instructions will cause an exception, at each stage of the pipeline, the state infomiation for the 
instruction at that stage is checlcpointed such Uiat, if an instruction causes an execption. the corresponding 
checkpointed state information is retrieved to restore the processorstata to the point of issuing that instruction. 
In addition, if a branch or floating point instruction is issued into a pipeline, and subsequent instructions are 
the speculatively issued behind such branch orfloating point instruction, the state inftormation for such branch 
or floating point Instruction is checkpointed such that, if the branch Is mispredicted or the floating point instruc- 
tion faults, the corresponding checkpointed state infonmation is retrieved to restore the processor state to the 
point of issuing the branch or floating point instruction. 

In another aspect of the invention, the defined set of logical registers have miitiple addressable sizes as 
sources and destinations of operands for instructions. The register translation means allocates physical reg- 
isters to one of said defined set of logical registers responsive to an instruction for vwiting to said one of said 
logical registere and the size associated with the logical register. 

In another aspect of the invention, the register translation means stores, for each physical register, a cur- 
rent indication and logical ID code indicating whether the physical register contains the cun-ent value for the 
logical register identified by such logical ID code. For each access to a logfcal register, the corresponding log- 
ical ID code is compared with each logical ID code stored vwth a physical register, and a corresponding physical 
ID code is output for the physical register containing the current value of the associated logical register. In ad- 
dition, the register translation unit is capable of storing, for each physical register, status information indicating 
whether a data dependency exists for an associated logical register. 

in another aspect of the invention, at least one of the execution pipelines includes an execution unit that 
is controlled by a microcontroller means. For selected instructions, the register translation means is also con- 
trolled by the microcontroller means. 

Embodiments of the present Invention may be Implentented to realize one or more of the following tech- 
nicatadvantages. Instructions are Issued without regaid to dependencies between themso that bubbles are 
not introduced into the pipeline unnecessarily, since dependencies may resolve themselves without stalling, 
e ither through normal instruction flow, or through mechanisms in the pip^ine to resolve dependencies. Instruc- 
tions may complete out of order after they can no longer fault, which is particularly advantageous with multi- 
box instructions which may take many clo<* cydes to complete and wouW otherwise significantly stall the flow 
of instructtons. D^wmdencies may be reduced by syiritehing instructions between the pipelines. Two executfon 
units in separate pipelines can be separately controlled to process a single instrucUon. using two separate 
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microinstruction flows, witlxtut significantly increasing complexity of the execution stages or the microse- 
quencer. Instructions can proceed independently througtt respective execution pipelines, allowing bubbles 
caused by dependencies to be removed during the processing of instructions - in, particular, read-af ter-write 
dependencies may be eliminated without recompiling the source code to ^ter the order of instructions. All of 

s these features and advantages serve to maximize pipeline execution perfomiance. 

Other areas where embodiments of the present invention may be implemented to provide technical ad- 
vantages are as follows. By maintaining the statusof pending writes to each of the physical registers, the control 
for allocating registers and providing status information is also simplified. Checkpointing state information re- 
lating to the physical registers allows the microprocesssorto restore the processor state after instructions that 

10 cause exceptions, mispredicted branches, floating point errors, or other instruction errors, within a single clock 
cyde, thereby greatly reducing the penally on recovery from such an error. Register renaming is supported 
for multiple-sized logical registers to provide elimination of certain data dependencies while maintaining com- 
patibility with existing instruction sets using multiple-sized registers. A phyeicat register can be quickly klen- 
tif led responsive to a request for a logicaf register, using a minimum of hardware. Maintaining status informatran 

IS associated with the physical registers allows data dependencies to be readily detected. The register translation 
unit used in implementing these features and advantages can be, for selected instructions, controlled directly 
by a microcontrdler controlling the execution unit<s) that process such Instructions (rather than by the normal 
method of using hardware control signals). 

20 Brief Description of the Drawtngs 

For a more complete understanding of the present invention, and the advantages thereof, reference is now 
made to the following descripttons taken in conjunction with the accompanying drawings, in which: 
Figure 1a illustrates a block diagram of a superscalar, superpiptfined mteroprocessor; 
2S Figure 1 b illustrates the seven pipeline stages of the microprocessor. Including X and Y execution pipes; 
Figure 2 is a block diagram of an exonplary computer system; 

Figure 3 illustrates a timing diagram showing the flow of Instructtons through the pipeline unit; 

Figure 4 illustrates a block diagram of the control mechanism Ibrcontrolllng the flow of Instructions through 

the pipeline unit; 

.30 Figure 5 illustrates a flow diagram illustrating out-of-order completion of instructions; 

Figures 6a-b and 7 illustrate a flow of instruction through the pipeline using pipe switching; 

Figure 8 illustrates a flow diagram describing the method of pipe switching; 

Figure 9 illustrates a functional tJock diagram of the register translation unit; 

Figure 10 illustrates the control registers used in the register transiation unit; 
35 FigufB 11 illustrates circuitry for generating bits for the Register Busy register; 

Figure 12a illustrates a representation of a variable size extended register under the X86 architecture; 

Figure 12b illustrates a flow chart for allocating iogrc^ registers with variable sizes; 

Figure 1 3 illustrates circuitry for selectable control of the register translation unit; 

Figures 14a-b illustrate the portions of the register translation unit for performing translation and hazard 
40 detection; 

Figures 15a-b illustrate operand forwarding; 

Figures 16a-b illustrate result forwarding; 

Figures 17a-b illustrate the detection of forwarding situations; 

Figure 18 is a block diagram of the forwarding circuitry; and 
45 Figures 1 9a-b illustrate pipe control for multi-box instructfons. 

Detailed Oescrlptlon of the Preferred Emttodlments 

The detailed description of an exemplary embodiment of the microprocessor of the present invention is 
so organized as folows: 

1. Exemplary Processor System 

1.1. Microprocessor 

1.2. System 

2. Generalized Pipeline Flow 
55 3- Pipeline Control 

3.1. Generalized Stall Control 

3.2. Pipe Switching 

3.3. Multi-box Instructtons 

5 
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3.4. Exclusive Instructions 

4. In order Passing\Out-of-Order Completion of Instructions 

5. Pipe Switching 

6. Issuing Instructions Without Regard to Dependencies 

7. Multi-threaded EX Operation 

8. Register Translation Unit 

8.1. Register Translation Overview 

8.2. Translation Control Registers 

8.3. Register Allocation 

8.4. Instructions With Two Destinations 

8.5. Checkpointing Registers for Speculative Branch Execution 

8.6. Recovery from ExcepUons 

8.7. Miciooontrol of the Register Translation Unit 

8.8. Register ID Translation and Hazard Detection 

9. Forwarding 

10. Conclusion 

This organizational table and the corresponding headings used in this detailed description, are provided 
for the convenience of reference only. Detailed description of conventional or known aspects of the micropro- 
cesser are omitted as to not obscure the description of the invention with unnecessary detail. 

1. Exemplarv ProeaMer System 

The exemplary processor system is shown in Figures 1a and lb, and Figure 2. Figures la and 1b respeo- 
tivdy illustrate the basic functional blocks of the exemplary sin)er8oalar, superpipelined microprocessor along 
with the pipe stages of the two execution pipelines. Figure 2 illustrates an exemplary processor system (moth- 
erboard) deagn using the microprocessor, 

1.1. Mlcroproeessor 

Referring to Figure 1 a, the major sub-blocks of a microprocessor 1 0 include: (a) CPU core 20. (b) prefetch 
buffer 30 . (c) prefetcher 35. (d) BPU (branch processing unit) 40, (e) ATU (address translation unit) 50. and 
(!) unified 1 6 Kbyte code/data cache 60. Including TAG RAM 62. A256 byte instruction line cache 65 provides 
a primary instructton cache to reduce instruction fetches to the unified cache, which operates as a secondary 
instruction cache. An onboard floating point unit (FPU) 70 executes floating point instructions issued to it by 
the CPU core 20. 

The microprocessor uses Internal 32.bit address and 64-bit data buses ADS and DBS. A 256 bit (32 byte) 
prefetch bus PFB. conesponding to the 32 byte line size of the unified cache 60 and the instruction line cache 
65, allows a full line of 32 instruction bytes to be transfen-ed to the instruction line cache in a single clod<. 
Interface to external 32 bit address and 64 bit data buses is through a bus interface unit BlU. 

The CPU core 20 is a superscalar design with two execution pipes X and Y. It Incudes an instruction de- 
coder 21 . address calculation units 22X and 22Y. execution units 23X and 23Y and a register file 24 with 32 
32-bit registers. An AC contrd unit 25 includes a register translation unit 25a with a register scoreboard and 
register renaming hardware. A microcontrol unit 26. induding a microsequencer and microROM. provides exe- 
cution control. . . 

Writes from CPU core 20 are queued into twelve 32 bit write buffers 27 - write buffer allocation is per- 
formed by the AC control unit 25. These write buffers provide an interface for writes to the unified cache ~ 
non-cacheabie writes go directly from the write buffers to external memory. The write buffer logic supports 
optional read sourcing and write gathering. 

A pipe control unit 28 controls instructton flow through the execution pipes, including keeping the instruo- 
tlons in order until It is determined that an Instruction will not cause an exceptton. squashing bubbles In the 
instruction stream, and flushing the execulton pipes behind branches that are mispredicted and Instructions 
that cause an exceptions. For each stage, the pipe control unit keeps track of which execution pipe contains 
the earliest instruction, and provWes a stall output and receives a delay input 

BPU 40 predicts the direction of branches (taken or not taken), and provides target addresses for predicted 
taken branches and uncondittonal change of flow instructtons (jumps, calls, returns). In addition, it monitors 
speculative execution in the case of branches and floating point instructions. i.e.. the execution of instructions 
speculatively issued af tw branches which may turn out to be mispredicted, and floating point instructions is- 
sued to the FPU whteh may fault after the speculatively issued instructions have completed executton. If afloat- 
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ing point instruction faults, or if a branch is mispredicted (which will not be known until the EX or WB stage 
for the branch), then the execution pipeline must be repaired to the point of the faulting or mispredicted instruc- 
tion (i.e.. the execution pipeline is flushed behind that instruction), and instruction fetoh restarted. 

Pipeline repairis accomplished by creating checkpdnts of the processor state at each pipe stage as a float- 
ing point or predicted branch instructton enters that stage. For these checkpointed instructions, all resources 
(programmer visible registers, instruction pointer, condition code register) that can be modified by succeeding 
speculatively Issued instructions are checkpointed. If a checkpointed floating point instruction faults or a 
checkpointed branch is mispredicted, the execution pipeline Is flushed behind the checkpointed instruction ~ 
for floating point instructions, this will typically mean flushing the entire execution pipeline, while for a mis- 
predicted branch there may be a paired instruction in EX and two instructions in WB that would be allowed to 
complete. 

For the exemplary microprocessor 10, the principle constraints on the degree of speculation are: (a) spec- 
ulative execution is allowed for only up to fourf loating point or branch instruoSions at a time (i.e.. the speculation 
level is maxi mum 4), and (b) a write or floating point store will not complete to the cache or external memory 
until the associated branch or floating point instruction has been resolved (i.e., the predictfon Is correct, or 
floating point instruction does not fault). 

The unified cache 60 is 4-way set associative (with a 4k set size), using a pseudo-LRU replacement al- 
gorithm, with write-through and wrrite-back modes. It is dual ported (through banking) to pemtit two memory 
accesses (data read, instruction fetch, or data write) per dock. The instruction line cache is a fully associative, 
lookaside Implementatton (relative to the unif ied cache), using an LRU replacement algorithm. 

The FPU 70 includes a load/store stage with 4-deep load and store queues, a conversion stage (32-bit to 
80-bit extended format), and an execution stage. Loads are controlled by the CPU core 20, and cacheable 
stores are directed through the write buffers 29 (!.e.. a write buffer is allocated for each floating point store 
operation).Refen-ing to Figure 1 b. the microprocessor has seven-stege X and Yexecutton pipelines: Instrtidton 
fetch IF, two instruction decode stages ID1 and ID2, two address calculation stages AC1 and AC2, execotkjn 
EX, and write-back WB. Note that the complex instruction decode ID and address calculatton AC pipe stages 
are superpipelined. 

The IF stage provides a continuous code stream Into the CPU core 20. The prefetcher 35 fetches 16 bytes 
of instruction data into the prefetch buffer 30 from either the (primary) instruction line cache 65 or the (sec- 
ondary) unified cache 60. BPU 40 is accessed with the prefetch address, and supplies taiget addresses to 
the prefetcher for predicted changes of flow, allowing the prefetcher to shift to a new code stream in one dock. 

The decode steges ID1 and ID2 decode the variable length X86 instructton set The instructton decoder 
21 retrieves 16 bytes of instruction data from the prefetch buffer 30 each dock. In ID1. the length of two in- 
structions is decoded (one each for the X and Y execution pipes) to obtain the X and Y instruction pointers - 
- a corresponding X and Y bytes-used signal is sent back to the prefetch buffer (whteh then increments for the 
next 16 byte transfer). Also in 1D1 , certain instruction types are determined, such as changes of flow, and im- 
mediate and/or displacement operands are separated. The ID2 stage completes decoding the X and Y instruc- 
tions, generating entry points for the microROM and decoding addressing modes and register fields. 

During the ID stages, the optimum pipe for executing an instruction is determined, and the instruction is 
issued into that pipe. Pipe switching allows instructkjns to be switched from ID2x to ACly, and from iD2y to 
ACIx. For the exemplary embodiment, certain instructions are issued only into the X pipeline: change of flow 
instructions, floating point instructions, and exdusive instructions. Exdusive instructions indude: any instruc- 
tion that may fault in the EX pipe stage and certain types of instructions such as protected mode segment loads, 
string instructtons, special register access (control, debug, test), Multiply/Divide, Input/Output, PUSHA/POPA 
(PUSH all/ POP all), and task switch. Exdusive instructions are able to use the resources of both pipes because 
they are Issued alone from the ID stage (i.e.. they are not paired with any other instruction). Except for these 
issue constraints, any instructtons can be paired and issued into either the X or Y pipe. 

The address calculation stages AC1 and AC2 calculate addresses for memory references and supply mem- 
ory operands. The AC1 stage calculates two 32 bit linear (three operand) addresses per dock (four operand 
addresses, which are relatively Infrequent, teke two docks). During this pipe stege, data dependencies are 
also checked and resolved using the register translation unit 2Sa (register scoreboard and register renaming 
hardware) - the 32 physical registers 24 are used to map the 8 general purpose programmer visible logical 
registers defined in the X86 architecture (EAX, EBX, ECX, EDX, EDI, ESI, EBP, ESP). During the AC2 stage, 
the register file 26 and the unified cache 70 are accessed with the physical address (for cache hits, cache 
access time for the dual ported unified cache is the same as that of a register, effectively extending the register 
set) ~ the physical address is either the linear address, or if address translation is enabled, a translated address 
generated by the TLB 60. 

The AC unit includes 8 architectural (logical) registers (representing the X86 defined register set) that are 
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used by the AC unit to avoid the delay required to access in AC1 the register translation unit before accessing 
register operands for address calculation. For Instructions that require address calculations. AC1 waits until 
the required data in the architectural registers is valid (no read after write dependencies) before accessing 
those registers. During the AC2 stage, source operands are obtained by accessing the register file 26 and the 
unified cache 60 with the physical address (for cache hits, cache access time fbrthe dual ported unified cache 
is the same as that of a register, effectively extending the register set) - the physical address is either the 
linear address, or if address translation is enabled, a translated address generated by the ATU 50. 

Tran^ated addresses are generated by the ATU (using a TLB or translation lookaside buffer) from the lin- 
ear address using information from page taWes In memory and workspace control registers on chip. The uni- 
fied cache is virtually indexed and physically tagged to permit, when address translation is enabled, set se- 
lection wHh the untranslated address (available at the end of AC1) and. for each set. tag comparison with the 
translated address from the ATU (available early in AC2). Chec*s for any segmenlallon andfor address trans- 
lation violations are also perfonmed In AC2. 

Instructfons are kept in program order until it is determined that they will not cause an exception. For most 
instructions, this determination is made during or before AC2 ~ floating point instructions and certain exclusive 
instructions may cause exceptions during execution. Instructions are passed in order from AC2 to EX (or in 
the case of floating point instructions. Id the FPU) - because integer instructions that may still cause an ex- 
ception in EX are designated exclusive, and therefore are issued alone into both execution pipes, handling ex- 
ceptions in order is ensured. 

The exeojtion stages EXx and EXy perfbntn the operations defined by the instruction. Instructions spend 
a variable number of clocks in EX, i.e.. they are allowed to execute out of order (out of order completion). Both 
EX stages include adder, logical, and shifter functtonal units, and in addition, the EXx stage contains multi- 
ply/divide hardware. ^ ^ ^. ^ ^ 
The write back stage V\® updates the registerf ile 24, condition codes, and other parts of the machine state 
with the results of the previously executed instructton. The register file is written in PH1 (phase 1 ) of WB, and 
readinPH2{phase2)ofAC2. 

Additional disclosure on the write buffer 27, speculative execution and the microsequencer may be found 
in U S Ser. No. 08/138.654, (Atty Docket No. CX00186), entitled "Control of Data for Speculative Execution 
and Exception Handling in a IWteroprocessor with Write Btiffer" by Garibay et al, filed concurrently herewith, 
U.S. Ser. No. 08/138,783, (Atty Docket No. CX06I8O), entitled 'Branch Processing Unit' to McMahon. filed 
concuirently herewith, U.S. Ser. No 08/138.781 , (Atty Docket No. 0X00181), entitled "Speculative Executton 
in a Pipelined Processor' to Biuhm. filed concuirently herewith, and U.S. Ser. No 08/138,855 , (Atty Docket 
No. CX00167) to Hervin et ai. entitled •Microprocessor Having Single dock Instructton Decode Architecture', 
filed concuirently herewith, all of whteh are incorporated by refiwence herein. 



1.2. System 

Referring to Figure 2. for the exemplary embodiment, microprocessor 10 is used in a processor system 
that includes a single chip memory and bus controller 82. The memory/bus controller 82 provWes the interface 
between the microprocessor and the external memory subsystem ~ level two cache 84 and main memory 86 
- controlling data movement over the 64 bit processor data bus PD (the data path Is external to the controller 
which reduces its pin count and cost). 

Controller 82 interfaces directly to the 32-bit address bus PADDR, and includes a one bit wide data port 
(not shown) for reading and writing registers within the controller. A bidirectional isolation buffer 88 provides 
an address interface between microprocessor 10 and VL and ISA buses. 

Controller 82 provides control for the VL and ISA bus interface. A VL/ISA interface chip 91 (such as an 
HT321) provides standaid interfaces to a 32 bit VL bus and a 16 bit ISA bus. The ISA bus interfaces to BIOS 
92 keyboard controller 93, and I/O chip 94, as well as standard ISA slots 95. The Interfeoe chip 91 interfaces 
to the 32 bit VL bus through a bidirectional 32/16 multiplexer 96 fomied by dual high/low word [31:16]/f15:0] 
isolatton buffers. The VL bus Interfeces to standard VL slots 97, and through a bidlrection^ Isolatton buffer 
98 to the low double word 131:0] of the 64 bit processor data bus PD. 



2. Generalized Pipeline Flow 

Figure 3 illustrates the flow of eight instructions ttirough the pipeline, showing the overlapping executton 
of the instructtons, for a two pipeline architecture. Additional pipelines and additional stages for each pipeline 
could also be provided, in the preferred embodiment, the microprocessor 10 uses an interna! clock 122 which 
is a multiple of the system dock 124. In Figure 3. the Internal clock is shown as operating at two times the 
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frequency of the system clock. 

During the first internal clock cycle 126. the ID1 stage operates on respective instructions XO and YO. Dur- 
ing internal dock cycle 128. instructions XO and YO are in the ID2 stage (XO being in ID2x and YO being in 
ID2y) and instructions X1 and Y1 are in the ID1 stage. During internal clodt cycle 130, Instructbns X2 and Y2 
3 ate in the ID1 stage, instructions XI and Y1 are in the ID2 stage {X1 being in lD2x and Y1 being in ID2y) and 
instructions XO and YO are in the AC1 stage (XO being in ACIx and YO being in ACly). During internal clock 
cycle 1 32. instructions X3 and Y3 are in the ID1 stage, instructions X2 «uid Y2 are in the iD2 stage, instructions 
X1 and Y1 are in the AC1 stage and instructions XO and YO are in the AC2 stage. The Instructions continue 
to flow sequentially through the stages of the X and Y pipelines. 
10 As shown in clocks 134-140, the execution portion of each instruction is performed on sequential clock 
oydes. This is a major advantage of a pipelined architecture - the number of instructions completed per clock 
is increased, without reducing the execution time of an individual instruction. Consequently a greater instruc- 
tion throughput is achieved without requiring greater demands on the speed of the hardware. 

The instruction flow shown in Figure 3 Is the optimum case. As shown, no stage requires more than one 
IS clock cycle. In an actual machine, however, one or more stages may require additional dock cydes to complete 
thereby changing the flow of instructions through the other pipe stages. Furlhennore, the flow of instructions 
through one pipeline may be dependent upon the flow of instructions through the other pipetine. 

A number of factors may cause delays in various stages of one or all of the pipelines. For example, an 
access to menrory may miss in the menmry cache, thereby preventing access of ttie data in the time required 
20 to process the instruction in one dock. This would require that either, or both, sides of the EX stage to delay 
until the data was retrieved from main memory. An instruction may require a hardware resource, such as a 
multiplier, which is only in one of the execution stages (in EXX in the X executksn pipe) in the illustrated em- 
bodiment In this case, the instruction must delay until the resource Is available. Data dependencies can also 
cause delays. If an instruction needs the result from a previous kistrudton, such as an ADD, it must wait until 
25 that instruction is processed by the execution unit 

Other delays are caused tiy "multi-box' instructions; i.e., instructions which are implemented using mul- 
tiple microinstructions, and therefore require more than one dock cyde in the EX pipe stage to complete. These 
instructions stop the flow of subsequent Instructions through the pipeline at the output of the ID2 stage. 
The flow of instructions through the pipeline is contndled by the pipe control unit 28. In the preferred env 
-.30 bodiment, a single pipe control unit 28 is used to control the flow of instructtons through both (or all) of the 
i. pipes. To control the flow of instructions through the pipes, the pipe control unit 28 receives 'delay" signals 
from the various units comprising the pipelines 102 and 104, and issues "stall" signals to the various units. 

Although a single pipe control unit 28 is used for both X and Y pipelines, the pipelines themselves are con- 
trolled independent of one another. In other words, a stall in the X pipeline does not necessarily cause a stall 
as in the Y pipeline. 

3. Pipeline Control 

Figure 4 illustrates the inter-stage communication between pipeline stages. The stages are arbitrarily des- 
40 ignated as stage N-1, stage N, and stage N + 1. Each stage has a unique input STALL from the pipe control 
unit (pipe controller) 28 and an output DELAY "nie DELAY output is enabled if the stage needs at least one 
more dock to complete the instrucUon it contains. For each pipeline, the pipe control unit 28 determines wheth- 
er a stage of a pipe is "done" based on the DELAY signal. A stage is "done" if it is ready to pass its instructton 
to a succeeding stage. The STALL input to a stage is enabled by the pipe control unit 28 if the stage cannot 
4S transfer an instruction to the succeeding pipe stege. because that succeeding stage is delayed or stalled. In 
the prefen-ed embodiment, a pipeline stage is stalled only if it is not delayed (i.e., the DELAY signal Is false). 

A "valid" pipe stage is one containing an instruction, either in progress or complete. An invalid pipe stage 
does not contain an instruction. An invalid pipe stage is said to contain a "bubWe". "Bubbles" are created at 
the front end of the pipeline 100 when the iDI and ID2 stages cannot decode enough instructtons to fill empty 
so AC1 and AC2 stages 112 and 114. Bubbles can also be created when a pipe stage transfers its instructton to 
the succeeding stage, and the prior steige is delayed. While the pipe stages do not Input or output bits indlcatii^ 
the valWIty of the stages, bubbles in the stages are tradted by the pipeline control unit 28. 

in some cases, a bubble in a pipe stage may be overwritten by an instruction from the preceding stage, 
referred to as a "stip." Pipe stages may also be "flushed", if they contain an instruction which should not com- 
ss piete due to an exception condition in a succeeding pipe stage. The signal FLUSH is an input to each pipe 
stage. A pipe stage generates an "exception" if its instruction cannot complete due to an error condition and 
should not transfer beyond the current stage. Exceptions can occur in the IF stage 106, the iD1 and ID2 stages, 
and the AC1 and AC2 stages for ail instructions. Certain instructions, designated as "exdusive" Instructions 
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may have exceptions occur in the execution stage 116. Furthermore, exceptions can occur for floating point 
instructions. 

3.1. Generallzsd Stall Control 

in the general case, the pipe controller will stall a stage of a pipeline if the stage is valid and it is not delayed 
and the next stage is either delayed or stalled. This may t>e described logically for a stage N as: 
STAU-N = VN»WN»(dN + 1 + STALLn ♦ i) 

where: 

Vn is true if stage N is valid, 
dfj is true if DELAY for stage N is true and 
I denotes that the succeeding term is negated. 
For a six stage pipeline, the description can be expanded as: 
STALLS = false 
STALLg = V5«ld5»d, 
STALL* = V4»ld4»(d6 + vs^Idg-d,) 
STALLa = V3«td,»{d4 + V4«!d4»(d5 + Vs^lds-ds) 
STALLz = V2«ld2«(d3 + Vs«!d3«{d4 + V4»ld4»(d6 + Vg-lds^de))) 
STALL, = Vi«1d,»(d2 + V2»ld2«(d3 + V3»!d3«(d4 + V4«ld«»<d5 + V5-lds.de)))) 
When the pipe control unit 28 stalls a stage of a pipeline, it does not necessarily stall the corresponding 
stage of the other pipeline. Whether the other stage is stalled depends upon the sequence of instructions and 
other factors, as described below. 

3.2. P4>e Switching 

While the general model above works for an architecture where instructions flow through the pipe they 
enter, a more complex control structure Is necessary when instructions are allowed to switch between pipes 
as shown in Figure 2. The mechanism for determining whether a switch will occur is descnbed in greater detail 
hereinbeiow. . . , .. 

In the preferred embodiment, the pipe control unit 28 keeps the instructions "in program order- (or m or- 
der-) until they are passed from their AC2 stage to the EX stage. "In order means that a lunior- instruction 
cannot be at a pipeline stage beyond a "senfor" instruction (a junior instruction's position in the sequence of 
instructions received by the microprocessor is after that of a senior instructton). although a junior instruotion 
may be at the same stage as a senior instructton. Thus, instructton It+i (the junior instruction) can be in ACIx 
while Instruction Ij (the senior instructton) is in ACiy. but 1^, cannot advance to AC2x until ly advances to 
AC2y. although It can advance without waiting for It*, to advance. w«^„^»hin 

Due to the sequential nature of the IF stage and the ID1 stage, instructions will notgetoutof orterwHhin 
these two stages. The flow of instructions through the ID2. AC1 and AC2 stages, however, necessitates mod- 
ifications to the general stall mechanism. To aid in controBing instructton flow in this situatton. the pipe control 
unit 28 maintains a control signal XFIRSTfor each pipe stage. If XFIRST is true for a particular stage then 
the instructton in this stage of the X pipeline is senior to the instruction in the con-esponding stage of the Y 
pipeline. In the illustrated embodiment, with h«o pipelines. XFIRST indicates which pipeline has the senior of 
thetwoinstructtonsfbraparticularstageifbrimplementationswithmorethantwopipesXFIRSTwouldindicate 

the reiatwe sentority of each instruction at each stage. 

At the output of the ID2 units, the pipe control unit must determine whether an instruction can proceed to 
either the ACIx or ACiy. A senior instructton can proceed (assuming it Is vaiW and not delayed) if the suc- 
ceeding stage of either pipeline is not delayed or stalled. Ajunior instructton can proceed (assuming it is valid 
and not delayed) only if the sentor Instruction in the corresponding stage of the other pipeline will not delay or 
stall. This can be described logfcally as: 

. S^ - V3X«(tl3X + STALL4X) 

StjY = VsY^dsY + d4y + STALL4Y) 

where sta specifies whether the corresponding pipeline will stall or delay at or below the 102 stage. 

STALLjx = V3x»!d3x»(tl4X*STALUx)*!XFlRST,»st3Y 
STALLsY = V3Y«ld3V(d«Y + STALUy) * XFIRSTj-stax 

3,3. Muitl-box Instructions 

The EX stage of each pipeline is controlled independently of the other EX stage by mkattinstructions from 



BNSDOCID <EP 0M90e5A1.l > 



EP 0 649 085 A1 



the microROM. While many instructions are implemented by a single microinstruction, and hence pass through 
the EX stage in a single clock cycle, some instructions require multiple microinstructions for their execution 
and hence require more than one clock cyde to comi^ete. These instructions are referred to as 'multi-box' 
instructions. 

Because the mIcroROM cannot be accessed by another instruction in the same pipeline during execution 
of a niulti-box instruction, a new insfa-uction cannot be passed from the ID2 stage of a pipe to an AC1 stage 
of a pipe until after the last microROM access for the mutti-box instruction. This is due to the microROM being 
accessed during AC1. As the multi-box instruction reads its last microinstruction, the following Instruction is 
alfowed to access the miCFoROM and enter AC1, so that no bubbles are produced. 

When the ID2 stage of a pipeline receives an instruction from the ID1 stage, it decodes whether an in> 
struction is multi-box. The pipe control unit 2S will stall the iD2 stage until the multi-box instruction is finished 
with the microROM. The EX stage will signal the end of a nujlti-box Instruction via a UDONE signal. The control 
necessary to support multi-box Instructions may be described as: 

stsK = !dK*V3x»(d4x + STAUw + MULTIBOX«»!UDONE4x) 
SW = !d3r»V9y»(d4y + STALUy + MULT1B0X4y«IUDONE4v) 
STALLax = stjx + IXFIRSTs^st^y 
STALLay = stay + IXFIRSTj-stsx 

Amult)-bOX instruction can use the resources of AC1 , AC2, and EX. Addittonal pipe control relating to multi- 
box instructions is discussed in connection with Figures 19a-b. In Figure 19a, lo is in the EX stage of the X 
pipeline and li, a multi-box instruction, is in the AC2 (I,,) and AC1 (l,t,)stages. From the viewpoint of the pipe 
control unit, the multi-box instruction It is treated as a singie instruction, and a delay in any stage occupied 
by the multi-box instruction will cause all stages associated with the multi-box instruction to stall. Thus, a delay 
in Itb will cause h, to stall, even though U, is In front of l,b in the pipeline. This is the only situation in which a 
delay In one stage will result in a stall in a succeeding stage. 

The pipe control unit 28 keeps track of the boundaries between instructions through the use of a head bit 
associated with each microinstruction. The head bit indicates whether the microinstruction is the first micro- 
instruction of an instruction, even if the instruction is a one-box Instruction. If the head bit is not true for a 
given microinstruction, then it is not the first microinstruction. By checking the head bit for each microinstruc- 
tion in a pipeline, the pipe control unit can determine boundaries between instructions and stall the stages ac- 
cordingly. 

3.4. Exclusive Instructions 

Another type of instruction used in the preferred embodiment is an "exclusive" instruction. Any instruction 
which has the possibility of causing an exception while executing in the EX stage is labeled as exclusive. Ex- 
ceptions are discussed in greater detail below. An instruction requiring multiple menwry accesses is labeled 
exclusive because it may cause an exception during such an access. Other instructions are labeled as exclu- 
sive because they modify control registers, memory management registers or use a resource such as a multiply 
hardware only available In one execution pipe. Exclusive instructions may be either single-box or multi-box. 
Exclusive instructions must be executed alone (i.e., no other instruction is used in the corresponding stage of 
the other pipe), due to the exduswe instruction's effect on the state of the maciiine or because the instruction 
can benefit from the use of both EX units. Examples of exclusive instructions that may cause an exception in 
the EX stage are DIV (divide), which may cause a divide by zero error, and instructions which must perform 
memory access during the EX stage like PUSHA. Other examples of exclusive instructions from the 486 in- 
struction set are: ARPL, BOUND, CALI., CLC, OLD, CLI, CLTS, CMC, CMPS, OIV, ENTER, HLT, IDIV, IMUL, 
IN, INS, tNT, INTO, INVD, INVLPG, IRET, LAHF, LAR, LEAVE. LGDT LIDT, LGS (PM), LSS (PM), LDS (PM), 
LES (PM), LFS(PM), LLDT, LMSW, LODS, LSL, LTR, MOV (SR), MOVS. MUL, OUT, OUTS. POPA, POPF, POP 
MEM, PUSHA, PUSHF. PUSH MEM, RET, SAHF. SCAS, SGDT, StDT, SLOT, SMSW, STC, STD, STI, STOS, 
STR, VERR. VERW, WAIT, and WBiNVD. where 'PM" denotes a protected mode instruction and "SR" denotes 
an instruction using special or control registers. 

The IDI stage decodes which instructions are exdusive. The pipe control unit 28 stalls exdusive instruc- 
tions at the ID2 stage until both AC1x and ACly stages are available. 

Figure 1 9b illustrates the effect of a delay of an exclusive multi-box instruction. 

An exdusive multi-box instruction occupies the EX, AC2 and AC1 stages for both the X and Y pipelines. 
If any of the stages occupied by the exdusive multi-box instruction delays, the corresponding stage of the op- 
posite pipeline will also delay, and the other stages associated with the multi-box instruction will be stalled by 
the pipe control unit in order to keep the multi-box instruction together. Hence, if instruction i^i, delays, then 
iyb delays and l„, ly,, i„ and ly, are stalled. With an exclusive multi-box instruction, two head bits, one for each 
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pipeline, are used to denote the beginning of the instruction. 
4. in order Pa8slng\Out-of-Order Completion of Insfructlons 

Refen-ing to Figures 1 a and 1 b, as described above, instructions are maintained inwderby the pipe control 
unit 28, until they pass from the AC2 stage to the EX stage. An instruction is considered "passed" to the EX 
stage once execution begins on the Instruction, since some preliminary procedures relating to advancement 
to the next stage, such as changing pointers to the instruction, may be done before all exceptions are reported. 

Once an instruction passes from an AC2 stage to an EX stage, it can complete its execution out-of-order 
(i.e.. the junior instruction can continue on to the write back stage before the senior instruction), unless there 
Is a resource or a data dependency which prevents the instruction from executing out-of-order. For example, 
a read-af ter-write (RAW) dependency would prevent an instruction from completing its EX stage until the de- 
pendency is cleared. Thus, an instrurtion such as ADD AX,BX cannot complete its EX stage until execution 
of a previous ADD BX,CX is completed, since the value of operand BX is dependent upon the previous instruo- 
Hon. 

However, junior instructions which pass to the EX stage without depend«ides on a senior instruction may 
complete, and it is ttierefbre possible for many instructions to pass a senior instruction which requires multipla 
clock periods in the opposite EX stage. This aspect of the i^referred embodiment greatly increases instruction 
throughput 

In the preferred embodiment, instructions are maintained in order until they cannot cause an exception. 
An exception Is caused by a program error and is reported prior to completion of the instruction that generated 
the exception. By reporting the exception prior to instruction completion, the processor is left in a state which 
allows the instruction to be restarted and the effects of the faulting instruction to be nullified. Exceptions in- 
clude, for example, divlde-by-zeio errors. Invalid opcodes and page faults. Debug exceptions are also handled 
as exceptions, exceptfordata breakpoints and single-step operations. After execution of the exception service 
routine, the Instruction pointer points to the instruction that caused the exception and typically the instruction 
is restarted. . 

Any instruction which is capable of causing an exception must be restartable. Accordingly, if an exception 
occurs, the state of the machine must be restored to the state prior to starting ttie instruction. Thus, changes 
to the state of the machine by the instruction causing the exception and subsequent instructions must be un- 
done. Typically, restarting the instruction involves resetting the state of the regtsterf lie and restoring the slack 
pointer, the instruction pointer and the flags. Because most exceptbns occur at the AC2 stage, the exception 
Is asserted at the output of the AC2 (except for exclusive instructions that cause exceptions In the EX stage). 
Instructfons are restarted at the ID1 stage. 

If the instruction causing the exception Is Junior to the Instruction In the corresponding AC2 stage (the 
neighboring instruction), then the neighboring instruction may continue to the EX stage. However, If the In- 
struction causing the exception is the senior instruction, both Instructions must be restarted. In other words, 
the state of the machine must be restored to the state which existed prior to any changes caused by the in- 
struction causing the exception and will allow instructions earlier in the program sequence to continue through 
the pipelines. . 

In the preferred embodiment, if a non-exduswe multi-box instruction is executing m one pipeline, multiple 
Instructions may flow through the other pipeline during execution of the multi-box Instruction. Because a multi- 
box instruction may use the AC1 . AC2 and EX stages, only the stage processing the microinstruction with the 
head bit for the multi-box instructions is kept in order. Hence, the AC1 and AC2 will not prevent junior instruc- 
tions from advancing if the stages do not contain the microinstruction with the head bit Two factors will control 
whether instructions can continue to flow: (1) whether the multi-box instruction creates a date dependency 
with a junior instruction or (2) whether the miJtj-box instruction causes a resource dependency with a junior 
instruction. 

Resource dependencies are created when the junior instruction needs a resource being used by the senior 
Instruction. For example. In the preferred embodiment only the X-pIpe EX unit has a multiplier. In wder to re- 
duce the area for the EX units. If a multi-box Instruction is operating In the X-side EX unit, a subsequent In- 
struction needing the multiplier cannot be executed until after com(rfetion of the senior instructton. 

Figure 5 illustrates a flow chart iBustrating the general operation of the pipe conird unit 28 with regard to 
the passing of instruction from the AC2 stage to the EX stage and the completion of the EX stage. The pipe 
controHer determines (200) whether an instructton can cause an exceptton at Its present stage (or beyond). If 
not, the instructton is allowed to complete (202) ahead of senior instructions (so long as those senior instruction 
can no tonger cause an exception). If the instruction may still cause an exception, ttien the pipe controller will 
not allow the instruction to change the state of the microprocessor before all senior instructtons have made 
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their changes to the state of the microprocessor at that state (204), In other words, ail stats changes are made 
in program order until the instruction can no longer cause an exception. 

in the more specific case, discussed above, block 204 of the flow diagram is implemented by maintaining 
the prc^ram order of instructions through the AC2 stage. For the majority of instructions in the X86 instruction 
5 set, it can be determined whether an instruction will cause an exception by the AC2 stage. Exclusive instruc- 
tions, which are allowed to cause an exception in the EX stage, are executed alone in the EX stage so that 
the state of the machine may be restored if an exception occurs. 

While the above description provides that the Instructions sre kepi in order through the point where they 
can no longer cause an exception, an alternative, more general, method of pipe control would be to allow in- 
10 structions to proceed out of order, so long as the instruction did not alter the state of the processor. 

5. Pim Switching 

Referring to Figures 1a and lb, the pipe control untt 28 controls whether an instruction switches between 
15 pipelines after ttie ID2 stage. Hence an inslrutS ion may progress through the i^peiines from ID2x to either AC1 x 
or AC1y and from ID2y to either ACIx or AC1y under ttie control of the pipe control unit 28. 

in the prefen-ed embodiment, the pipe control unit 28 will decide which ppe, X or Y, to place an instruction 
based on certain criteria. The fffst criteria is whether one pipeline has a bubble which could be removed. If so, 
the pipeline will try to move the most senior of the instructions in the ID2 stage into that pipeline. Thus if AC1 x 
20 is valid and ACly is invalid, and the instruction in ID2x is the senior of the two instructions in the ID2 stage, 
then the pipe control unit 28 will transfer the instruction from ID1x to AC1y. 

The second crHeiia is to prevent new bubbles in this pipeline from occurring. To prevent bubbles from oc- 
curring, the pipe control unit 28 will attempt to keep dependent pairs of instruction, where the dependent in- 
struction may be delayed, from affecting other instrucltons. To accomplish this, in the preferred embodiment. 
25 the pipe control unit 28 will keep adjacent instructions In program order from being on top <rf one another in a 
pipeline. 

Figure 6a illustrates this problem. At time T1, instruction 11 is in EXx, instruction 12 is in EXy, instruction 

13 is in AC2y and instruction 14 is in AC2x. 12 has a read-aftw-write dependency on 11 ; in other words, for in- 
struction 12 to be properly processed In the EXy stage, it must wait for the outcome of instruction 1 1 in the EXx 

.30 stage. For example, II could be an ADD AX, BX instruction and 12 could be an ADD AX,CX instruction. 12 cannot 
complete because one of its operands will not be ready until after II cwnpletes. At time T2, 11 completes, leav- 
ing a bubble in EXx. 12 is executing in EXy. 13 cannot proceed to the EX stage until 12 completes. 14 cannot 
proceed to the EX stage because it is junior to 13 and, as stated above, instructions cannot proceed past a 
senlcff instruction until entering the EX stage. 

35 The consequence of maintaining adjacent instructions in program order from being on top of one another 
in a pipeline is shown in Figure 6b. In this example, the pipe control unit 28 has ordered the pairs in AC2 at 
time T1 such that 13 is in AC2x and W is in AC2y. The reason for ordering the instructions in this manner is to 
prevent 13 from being above 12 in the Y pipeline. Thus, at time T2, II has completed the EX stage and moves 
to the writeback stage. 13 can now move into EXx, thus preventing the occurrence of a bubble in EXx. Similarly, 

40 15 can move into AC2x. 

In some instances, the pipe control unit28 must place adjacent instruction above one another in a pipeline. 
Typically, this situation is caused by an X-only instructton, whfeh must be placed in the X pipeline, or because 
the pipe control unit 28 needed to remove a bubble, which necessitated a perturbation in the desired order. 
Figure 7 illustrates such a situation. At time T1. 11 and 12 are in EXx and EXy, respectively, 13 and 14 are in 

4S AC2x and AC2y respectively, 15 and 16 are in AC1 y and ACIx, respectively, because 16 is an X-oniy instructton 
and therefore the pipe control unit 28 was forced to put 16 into ACIx, even though doing so forced 15 to be on 
top of 14 in the Y pipeline. 17 and 18 are in ID2x and ID2y, respectively. 14 has a read-af ter-write dependency 
on 13 and 16 has a read-after-write dependency on 15. At T2. II and 12 have moved to the WB stage and 13 and 

14 have moved into the EX stage. 16 has nwved to AG2x and 15 has moved to AC2y; therefore the pipe control 
50 unit 28 has allowed 17 and 18 to switch pipelines In order to prevent 17 from being on top of 16 In the X pipeline. 

19 and 110 have moved Into ID2. 

At T3, 13 has completed in EXx and moved to EXy and 14 remains In EXy to complete Its operation. As 
described in connection with Figure 6a, neither 15 or 16 can proceed down either pipeline, and thus instructions 

15 and above remain in their respective stages. At T4, 14 completes and 15 and 16 move into EXy and EXx, re- 
S5 spectively. 17 and 18 move to AC2y and AC2x, respectively, 19 and II 0 move to AC1y and AC1 x, respectively, 

to prevent adjacent instructions 19 and 18 from both being In the X pipeline. 111 and 112 move into the ID2 stage. 

AtT5, 15 comii^etes and 17 moves into EXy. 16 stays in EXx because of the read-after-write dependency. 
19 moves to AC2y, 111 moves to ACly and 13 moves to iD2x. As can be seen, the potential bubble created by 



13 



EP0649 08SA1 



16 remaining in EXx has been avoided due to proper sequencing of the instructions by the pipe control unit 

Although a specific ordering of instructions has been described in connection with Figures 6-7. other meth- 
ods of sequencing instructions may be used to promote the eff icientf low of instructions through the pipeline. 
Also, the point of switching need not be at the ID2 stage. As shown above, the pipe control unit 28 uses the 
switching point to provide a sequence of instructions which reduces dependencies between instructions which 
could cause bubbles to be o-eated. 

Aflow chart illustrating the general operation of Ihe pipe control unit with regard to pipe switching is shown 
in Figure 8. The pipe controller determines (210) whether the instruction must be placed down a certain pipe- 
line, such as an X-only instruction. If so. the pipe control unit 28 will place (212) the instruction in that pipeline 
as available, if the instruction can be placed in any pipe, the pipe control unit 28 will determine (214) whether 
there is a bubble in either of the pipelines which could be filled. If so. the pipe control unit 28 will move 2 6) 
the instruction into the stage with the bubble. If there are no bubbles (or if both pipelines are available), the 
pipe control unit 28 will place instructions in the X or Y pipelines based on an evaluation of the best sequence 
for avoiding dependencies (218 and 220). As described above, in one embodiment, the pipe controller avoKls 
dependencies by avoiding the placement of adjacent instructions above one another in the same pipeline. 

6. Issuing instructions Without ttagaxd to Dependencies 

Instructions from ID1 to 1D2 without regard to dependences which nray exist between the two instrudions. 
An alternative approach fe to determine whether a pair (or more) of instructions have a «*«P«"''f "/V' «f 
issue the first instruction with a bubble in the corresponding stage in the other pipe such tliat the bubble re- 
mains paired with the issued instruction through the pipeline. Consequently, the number of instructions that 
are processed over a gh/en time period will be reduced. 

To improve performance, the microprocessor disclosed herein will issue instructions wrth dependencies 
simultaneously into the pipelines. The dependency is checked at the point whe,« the "^^ 
the date for which it is dependent. That is. the point at which the dependency will cause a stall in the pipel ne 
depends upon the nature of the dependency - if the dependent data is needed for an Jf" 
stall will occur in AC1 . while if the data is needed for execution, the stall will occur in EX. Until the time of the 
stall, movement of the instructions in the pipe or other mechanisms may resolve the dependency, and thus 
provide for a more efficient flow of instructions. 

7. MuttHhreaded EX Operation 

Referring to Figure la and 1b. the microsequencer circuitry 23 provides independentflows of microinstruc- 
tions to the EX stages. Hence, control of the EXx stage is independent of control of the EXy stage. 

By controlling the execution of both EX stages by two independent microinstruction flows rather than us- 
mg a single microinstruction word to control both EX stages, greater flexibility in performing the instruction is 
provided! thereby increasing perfomiance. Further, the additional hardwara which would be necessary for sin- 
gle microinstruction control of the two EX stages is avoided. „ ^„ ... A^„„.ll 

in particular, some exclusive instructionscanbenefilfromtheuseof both the EXxand EXy stage. As well 
as using both EX stages, the exclusive instruction has access to both AC stages for address calcuiatwns -in 
such a case, the AC is also microinstruction controlled. 

While both EX (and AC) stages are being used to execute a single instruction, the respective EX stages 
continue to receive two independent flows of microinstructions from the microsequenoer. The operation of the 
two EX units is maintained by proper coding of the microinstructions. 

8. Register Translation Unit 

8.1. Register Translatlcm Overview 

Referring to Figure la and lb. the register translation unit 25a is used for Instruction level data hazard 
detection and rosolution. Before completing execution in the EX pipe stage, each instruction must have its 
source operands valid. The register translation unit is used to track each of the registers to determine if an 
sctive instruction has an outstanding write (a "write pending"). ^ „ ^ 

If an instruction has a source register with a write pending, a residual control word (See Section 9 and 
Figures 15a-b and 1 6a-b) associated with the instruction is marked at the AC1 stage to indicate that the source 
register has a write pending. As the Instruction progress through the pipeline, each stage "snoops" the write- 
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back bus to detect a write to the dependent register. If a write to the dependent regisler is detected, the write 
pending field in the residual control word associated with the source register is cleared. 

Figure 9 illustrates a general block diagram of the register translation unit 25a. The Physical Register File 
(24 in Figure la) includes thirty two physical registers for storing information directed to the eight logical reg- 

5 isters of the X86 architecture. Access to the physical registers is controlled by the register translation unit 25a. 
State information relating to the physical and logical registers is stored in translation control registers 236. 
Translation control circuitry 238 manages access to the physical registers based on the state information. 

A true data dependency arises from a RAW hazard which prevents the instruction from completing. There 
are also dependencies corresponding to a WAR (write-after-read) hazard, catled an antidependency, and a 

10 WAW (write-after-write) hazard, catled an output dependence. Antidependencies and output depmdencies, 
which are not true data dependencies, can be removed through the use of reg isler renaming, which is controlled 
by the register translation unit 2Sa. In register renaming, more physical registers are provided than the archi- 
tecture defines (logically orarchitectursdly). By assigning a new physical register each time a logical register 
is to be written (destination of result), tiie register is renamed and eliminates both WAR and WAW hazards. 

IS The X86 architecture defines 8 general purpose programmer visible registers (EAX, EBX, ECX, EDX, EDI, 

ESI, EBP, ESP). In the illustrated embodiment, there are 32 physical registers which will be used to map the 
eight general purpose registers (logical registers). Since the microprocessor will predict and execute instruc- 
tions before a conditional branch has completed execution, the register translation unit must be able to handle 
the consequences of a mispredicted branch. If the prediction is incorrect, the microprocessor must restore the 

20 state bad( to the point of the conditional branch. As described below, chedqMinting Is used to save state in- 
formation before the speculative path is taken. Recovery from a incorrectly predicted conditional branch In- 
volves reverting to the checkpointed physical registers. 

For each AC1 pipe stage, the following operations are completed by the register translating and renaming 
hardware. 

25 1 . Allocate (rename) up to two new registers which are destinations of the cun-ent instructions in the AC 

pipe stage. The allocation will proceed in program order due to dependencies created if both instructions 
specify the same register as destinations. 

2. Check for RAW dependencies for instructions in AC pipe stage. 

3. Check physical register ID's on the write back bus for registers used during AC for address calculations 
30 to enaUe bypassing and clearing of the write pending bit in the register translation unit 

4. Logical to physical translattons for up to four registers. 

8.2. TIranslatlon Control Registers 

36 Figure 10 illustratas the translation control registers 236. ALogical ID register240 maps logical registers 
to physical registers. The Size register 242 stores a code corresponding to the size of the logical register to 
which the physical register is assigned. This aspect is discussed in greater detail below. The Current register 
244 indicates the registers which are the most recently assigned for a given logical register. Thus, every time 
a new physical register is allocated, the current bit for the physical register which previously was the cun^ent 

40 register for the corresponding logical register is turned off and the current bit for the newly alfocated register 
is turned on. Consequently, at any time, the Cunsnt register 244 has eight bits on and twenty-four bits off. 
For each physical register, the Pending register 246 has a bit which indicates whether a write to that physical 
register is pending. 

Four checkpoint registers 248, ChkpntO - ChkpntS, are used to store a copy of the Cun^nt register 244, 
45 each time a checkpoint occurs. In the preferred embodiment, checkpoints occurwhenever a conditional branch 
or a floating point operation passes through AC1 . The checkpoint registers 248 are written to in a rotating basis. 
Exception Restn^ registers 250 store the current bits for each instruction in AC1 , AC2 and EX, as they existed 
before the allocation for the instruclton was made in the AC1 stage. The contents of the Exception Restore 
registers follow the Instructtons as they move from stage fo stage. 

so 

8.3. Register Allocation 

For each instructkin which writes results to a logical register, a new physical register is allocated by the 
register translation unit 25a. The register allocation process first identifies a "free" physical register, i.e. a reg- 
55 ister which is not in use. Detection of free registers is discussed in connection with Figure 11. Once a free reg- 
ister is located, the logical register number is placed in the physical register data structure and is marked cur- 
rent The previous physical register which represented the logical register has its current bit cleared. 

Circuitry for identifying a free register is shown in Figure 10-11. A Register Busy register 252 has one bit 

15 



BNSDOCID.<EP CI6*90eSAt.l.» 



EP 0649 085 A1 



location for each physical register. Each bit of the Register Busy register is set responsive to corresponding 
locations in the Pending, Current, Checkpoint and Exception Restore registers. As shown in Figure 11, bit n 
of the Register Busy register 252 is the result of a logical OR operation on the nth bit of the Pending, Current, 
Chedcpoint and Exception Restore registers. A register is free if it corresponding bit in the Register Busy reg- 
5 ister is set to '0' and is in use if the corresponding bit is set to *1 '. 

Upon allocation, the corresponding bit of the Current register is set to "1" to mark the physical regi^er as 
the cun-ent register. A code is placed in the connesponding three bits of the Logical ID register 240 to indicate 
the logical register to which the physicd register is assigned, and the corresponding bits of the size register 
are set to the size of the logical register being allocated (see Table 1 below). The pending bit corresponding 
10 to the physical register is also set The instruction causing the allocation will write to the assigned physical 
register and any reads by subsequent instructions from the logical register will resdt in reads from this new 
physical register. TTiis renaming will occur during the AC1 pipe stage and will be processed in program order. 
Processing the Instructions in program order is required for the case where both Instructions in ACIx and AC1 y 
specify the same logical register as a source and destination. As an example, this can occur if both instructions 
IS are an ADD and the AX register is defined as both a source and destination. Through register renaming two 
new physical registers will be allocated for the logical AX register, with the last one being marked as the cun-ent 
one. The example below shows how each instruction is renamed. 

First instruction: (ADD AX, BX). Assume the physical register IDs for the AX and BX registers are currently 
"1" and "2", respectively, when the ADD instruction is received in AC1. Since the AX register is also the 
20 destination, a new physical register will be allocated for AX. "niis physical register will have an ID of '3' 
(assuming that physical register "3" is free). The add instruction would then add physical registers "1 * and 
"2" and write the results into register "3'. 

AX (physical register 1) ♦ BX (physical register 2) =* AX (physical register 3) 
Second instruction: (ADD AX.BX). Since the AX register is a destination, a new physical register will be 
25 allocated for AX. This will have the ID of "4". Since the previous instruction renamed the AX register to the 
physical "3", it will be used as the AX source for the ADD, since it is marlced as current as of the time of 
the allocation. Therefore, the second ADD instruction would add physical registers "3" and "2" and write 
the results into register "4." 

AX (physical register 3) + BX (physical register 2) -> AX (physical register 4) 
30 Since the X86 architecture allows certain registers to be addressed as words (e.g. "AX"), low bytes (e.g. 
"AL"). high bytes (e.g. "AH") or double words (e.g. "EAX'), a size is specified for each allocation, based on 
how the register was specified by the instruction. The possible allocataWe portions of a register are shown In 
Figure 12a for the EAX register. Each physical register has a corresponding two bit field in the Size register 
which stores the code. Exemplary codes are shown in Table 1 . 



TABLE 1 



Codes for Size Register 


Code 


Size Example 


00 


word AX 


01 


low byte I AL 


10 


high byte ' AH 


11 


double word EAX 



A method for register translation using variable size registers is shown in the Figure 12b. The translation 
control circuitry in the register translation unit (25a In Figure la) compares the size of the logical register to 
be allocated with the size of the cun-ent register for that logical register and detennines whether the register 
may be allocated or whether the instruction must be stalled. 

A request for allocation is received (258). and the size of the register to be allocated is compared (260 and 
262) with the size of the corresponding current register. If two instructions specify the same logical destination 
register but as different sizes (i.e., AH and AL), where the logical destination of the second instruction in pro- 
gram Older does not fully include the portion of the logical register allocated to the first instruction, a RAW 
dependency based on size is created. Accordingly, a register cannot be allocated until this dependency has 
been resolved (264). 
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If the size of the logical register with a pending write of an instruction encompasses the portion of the logical 
register specified by an earlier instruction (as defined in Table 2 below, using the EAX register as an example), 



the new register can be allocated (266). 


Table 2 


Register Sizes which Allow Allocation for Registers with Size Dependencies 


Size of Register with Pending Write 


Allowable Sizes for Allocating New Registers 


AL 


AUAX.EAX 


AH 


AX, EAX 


AX 


AX, EAX 


EAX 


EAX 



8.4. Instructions With IWo Destinations 

The majority of X86 instructions specify only one register destination. There are a few which specify two 
register destinations (e.g., XCHG AX.BX). So as not to complicate the register translation unit hardware, only 
one destination for an Instruction can be renamed each dock. Therefore, a special case for the Instructions 
which specify two destinations Is used. These instructions, while In the AC1 pipe stage, will stall any other 
instruction from using the register translation hardware for one clock, so the second destination can be re- 
named. 

8.5. Checkpointing Registers for Speeuiative Branch Execution 

Referring to Figure 10, the microprocessor will predict the direction of a branch (conditional change of flow), 
and begin executing instructions In the predicted direction, before the branch has been resoh^ed. If the branch 
is misprediction, the microprocessor must restore the processor state back to the point of the branch. 

The register translation unit (25a in Figure 1a) allows the microprocessor 1o save the processor state at 
the boundary of a branch by checkpointing the registers - copying the Current register 244 to one of the Check- 
point registers 246 - befbre speculatively executing instructtons in the predicted dinaction of the branch. The 
Checkpoint registers 248 are written to In a rotating order. 

In the preferred embodiment, the registers are also ched(pointed for floating point operations. 

Since checkpointing allows the microprocessor to return to the state defined by the checkpoint registens, 
it could be used for every instruction. However, resources must be provkied for each checkpoint, and therefore, 
there is a trade-off between the fundtonaiity of checkpointing and the hardware resources to be allocated to 
checkpointing. In the illustrated embodiment, four checkpoint registers are used, allowing up to four check- 
points at any one time. 

Recovery from an incorrectly predicted branch (or a floating point enror) involves reverting to the check- 
pointed physical registers. When a branch enters the AC stage of the pipeline the Current register 244 is copied 
to one of ttie Chedtpoint registers 248 While executing instructions in the predicted direction, new registers 
will be allocated. When a new register is attocated, the physk:al register that is marked current will clear its 
current bit, as it nomially would. If the predicted direction is incorrect, then the Checkpoint register 248 asso- 
ciated with the branch is copied to the current register, which will restore the state of the physical registers to 
the state which existed immediately prior to the branch. Hence, the microprocessor may recover from a mis- 
predicted branch or a floating point error in a single clock cycle. 

8.6. Recovery from Exceptions 

Referring to Figure 10, recovery from exceptk)ns is similar to recovery from a mispredicted branch. If an 
exception occurs with a ghwn stage (AC1x, AC1y, AC2x, AC2y, EXx, EXy) . the Exception register 250 asso- 
ciated with that stage is copied into the current register. Since the Exception register for a given st^e contains 
a copy of the Current register 244 as It existed prior to the allocation (which occurred in the AC1 stage) for the 
present instruction in the stage, copying the associated Exception register 250 to the Cunent register 244 wilt 
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reset the association of the physical registers to the logical registers to that which existed before the exception 
causing instruction entered AC1 . Thus, the present invention allows the state of the machine to be modified, 
even though the instruction modifying the state may later cause an exception. 

To determine which Exception register should be used to restore the Current register 244, the register 
translation unit 25a uses information from the pipe control unit (28 in Figure 1a). When an exception occurs, 
the pipe control unit will flush stages of the pipelines. Using signals from the pipe contrrt unit which indicate 
which stages were flushed, and which stages were valid at the time of the flush, along with the XFIRST bit for 
each stage, the register translBHon unit will determine the most senior flushed stage. The exception register 
corresponding to this stage is copied into the Current register 244. 

8.7. MIerocontrol of the Register Thmslatlon Unit 

Referring to Figure 1a, the register trandatlon unit 25a is normally controlled via signals produced by the 
pipeline hardware. In certain instances, however, it is beneficial to control the register translation unit 2Sa 
through microcode signals generated by the microsequencer in microcontroller 26 as part of an instruction. 
For example, exclusive instructions wilt require access to the register translation unit hardware to determine 
which physical register is mapped to a logical register. Instructions such as PUSHA (push all) require a logical 
to physical translation of all eight logical registers during their execution. 

To efficiently accommodate the need to access the register translation unit by excluave instructions, con- 
trol signals are multiplexed Into the register translation unit 25a through multiplexers controlled by the micro- 
code, as shown in Figure 1 3. Control signals generated by the hardware and by the microcode (via the micro- 
sequencer) are input to a mullirrfexer 260. The multiplexer passes on of the control signals based on the value 
of a Microcode Select signal which controls the mulBplexer 260. The Microcode Select signal is generated by 
the microcode. Hence, if the microcode associated with an instruction needs the register translation unit 25a. 
one of the microinstruction bits enables the multiplexers 280 to pass the microcode control signals rattier than 
the signals from the pipeline hardware. Other bits of the microin8truction(s) act as the control signals to the 
register translation unit 25a to enable the desired function. Instructions which do not need the register trans- 
lation unitfbr their execution will enable the multiplexers to pass only the control signals generated by the hard- 



8.8. Register ID Translation and Hazard Detoctton 

Responsive to a request for a logicad register, the register translation unit (25a in Figure la) will supply the 
identification of the current physical register mapped to the requested logical register. Also, the register trans- 
lation unit will output eight bits, one for each logical register, indicating whether the current physical register 
for the associated logical register has a write pending. These bits are used to detect RAW hazards. 

in the prefen-ed embodiment, the register translation unit is formed from a plurality of cells, each cell rep- 
resenting one physical register. Figure 14a illustrates a schematic representation of one cell 270 as it relates 
to register ID translation and hazard detection. In response to a 3-bit code representing one of the eight logical 
registers placed on the transjd bus, a 5-bit code representing the cun-ent physical register for the specified 
logical register will be place on the phy_id bus. Each cell 270 receives the code from the transjD bus. The 
3-bil code on the transjd bus is cmnpared to the bits of the lJ>gical ID register corresponding to that cell. In 
the preferred embodiment, the bits of the control registere 240-252 are dwided between the cells such that 
each ceR contains the bite of each register 240-252 corresponding to its associated physical register. 

The Logical ID bits are compared to the 3-bit code by comparator 272. The match signal is enabled if the 
3-bit code equals the Logical ID bits. The match signal and the Current bjt for the cell are Input to AND gate 
274. Hence, if the physical register represented by the cell is associated with the specified logical register, 
and if the physical register is marl<ed as the current register for the specified logical register, the output of the 
AND gate 274 will be a "1*. The output of AND gate 274 enatrfes a 5-bit tri-stete buffer 276. If the output of the 
AND gate is a "1", the buffer passes the i^yslcal ID associated with the cell to the phyjd bus. For a given 
logical register ID, only one physical register will be current; therefore, only one cell wiii have Its tri-stete buffer 
enabled. 

The Logical ID bits are also input to a 3-to-8 decoder 278. Thus, one of the eight outputs of the decoder 
278 will be enabled responsive to the logical register mapped to that cell. Each output of the decoder 278 is 
coujrfed to the Input of a respective AND gate 280 (individually denoted as AND gates 280a-280g). Each AND 
gate 280 also receives the Cunent and Pending bitsforthe physical register associated with the cell. The output 
of each AND gate 280 is coupled to a respective hazard bus associated witti each logical register. For example. 
AND gate 280a is coupled to the hazaidEAX bus which is associated with the EAX logical register. AND gate 
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280g is coupled to the hazardESP bus which is associated with the ESP logical register. 

For a given cell, at most one AND gate 280 will be enabled, if that celt represents the logical register map- 
ped to the physical register represented by that cell, and if the physical register is marked current with a write 
pending. As shown in Figure 14b, the hazard buses perform a wired-OR on the outputs of each cell. For each 
s hazard bus, only one of the associated AND gates 280 wifl be enabled, since only one Current bit associated 
with the logical register will be enabled. If the Pending bit associated with the current physical register is also 
enabled, the conresponding AND gate 280 will be enabled and the hazard bus will indicate that there is a write 
pending to that logical register. This infomiation is used to detect RAW hazards. 

10 9. Forwarding 

As described above, a RAW dependency will cause the microprocessor to stall on the dependent instruc- 
tion, in the preferred embodiment, 'Yorwarding* Is used to eliminate RAW dependencies in certain situations 
in order to increase instruction throughput. Forwarding modifies instruction data to eliminate RAW depend- 
is encies between two instructions which are both in the EX stage at the same time. 

Two types of for warding are used in the preferred embodiment 'Operand forwarding" forwards, under cer- 
tain conditions, the source of a senior MOV (or 8imitar)Jnstruction to a junior instruction as source data for 
that instruction. "Resultforwanjing'forwards, under certain conditions, the result of a senior instruction directly 
to the destination of a subsequent MOV (or simitar) instruction. 
io The following code illustrates operand fbrwarding: 

1) M0VAX.BX 

2) ADDAX.CX 

Referring to Figures ISa-b, using operand forwarding, the junior ADD instruction will be effectively modi- 
fied to BXK;X=»AX. Each instruction is associated with a residual control information stored in a residual con- 

2S trol word which includes the sources (along with fields Indicating whether there is a write pending to each 
source) and destinations for the operation, among other control information (not shown). Thus, assuming that 
physical register "0* is allocated to logical register BX and physical register *1 " is allocated to logical destination 
register AX, a "0* is stored in the SRCO (source 0) field and a "1 ■ is stored in the PESO (destination 0) field of 
the residual contrd word associated with the MOV instruction. Similarly, assuming ttiat physical regis^ "2* 

30 is allocated to logical register OX, forwarding allows a *r to be stored in the SRCO f ield of the residual control 
word associated with the ADD instruction (since the destination register of the MOV instruction is one of the 
sources for the ADD instruction) ~ a "a* is stored in the SRC2 field and a '3' is stored in the DESO field (since 
register renaming will find a free register for the logical destinatkin AX register). 

As can be seen, a RAW dependency exists between the MOV and the ADD instruction, since the MOV 

35 Instruction mustwrite to physical register'l" priorto execution of the AN) instruction. However, usingoperand 
forwarding, this dependency can be eliminated. As shown in Figure 15b, operand forwarding does not affect 
the MOV command. However, the residual control word of the ADD instruction is modified such that the SRCO 
field point to physical register associated with logical source register BX for the MOV. 

Similarly, result forwarding modifies the residual control word of a junior MOV instruction with the result 

40 of a senior instruction. To describe result forwarding, the following sequence is used: 

1) ADDAX.BX 

2) MOV CX.AX 

Referring to Figures 1 6a-b, resultforwarding modifies the MOV command such that the CX register is load- 
ed with the data generated as the result of the ADD instruction. Physical register *0" is allocated to logical 

45 source register BX, physical register "1" is allocated to logical source register AX, physical register "2" is allo- 
cated to logical destination register AX, and physical register '3' is allocated to logical destination register CX, 
Thus, a RAW dependency exists between the two instructions, since the destination of the ADD instruction 
(physical register 2) is the source of the MOV instruction. 

After resultforwarding (Figure 16b), the ADD instruction remains unchanged: however the residual control 

so word associated with the MOV Instruction is modified such tiiat the destination register CX (physical register 
3) receives its data from the write-back bus associated with the EX unit performing the M)D (shown in Figure 
16b as the X-slde write-back bus) at the same time AX is written. Consequently, the RAW dependency is elim- 
inated, and both the ADD and the MOV instructions may be executed simultaneously. 

Forwarding ts used only under certain conditions. One of the instructions in the sequence must be a MOV 

55 instruction or similar 'non-working* instruction. A non-working instruction is one that transfers operand data 
frcmi one location to another, but does not perform substantive operations on the data. A working instruction 
generates new data in response to operand data or modifies operand data, in the X86 instruction set, the non- 
woridng instructions would include MOV, LEA, PUSH <reg>, and POP <reg>. Also, OR <reg1 >,'<reg1> and AND 
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<reg1>,<reg1> (where both the source and destination registers are the same) can be considered "non-work- 
ing" instructions because they are used only to set flags. 

Further, in the preferred embodiment, forwarding is used only in cases where both instructions in the se- 
quence are in their respective EX units at the same dock cycle. Forwarding searches up to three instructions 
(in program order) ahead of an instruction in the AC2 stage to determine whether a forwarding case can occur. 
Even if the forwarding instructfon is two instructions ahead, forwarding can occur if the forwarding instruction 
delays in the EX stage long enough for the instruction in the AC2 stage to move to the EX stage. 

As shown in Figure 17a. in the situation where instructions "1" and '2" are in the X- and Y-side EX units, 
respectively, and instmclions "3* and "4" are in the X- and Y-side AC2 units, instniction "4" looks at instructions 
"3" and "1" to determine whether an operand or result forwarding situation is possiWe. Since instruction "4" is 
stili in the AC2 stage, it cannot forward with instruction "1* unless instruction "I" delays in the EX stage until 
instruction "4" is issued Into the Y-side EX stage. Similarly, if a forwarding situation is possible with instruction 
"3", the forwarding vwll occur only if both "3" and '4" are issued to the respective EX stages such that they are 
concurrently in the EX stage for at least one clo<* cycle. 

Instruction "4" does not look to instruction '2" for a forwarding situation, since both instructions cannot 
be concurrently in the EX unit given the architecture shown. Bypassing may be used to reduce the latency 
period of RAW dependencies between instruction "4" and "2". With alternative pipeline configurattons. such 
as an architecture which allowed switehing pipes at the AC2/EX boundary, it would be possible to forward be- 
tween instruction "4" and "2*. 

Figure 17b Illustrates the conditions monitored for forwarding in connection with instruction '3" given the 
initial condittans set forth in connection with Figure 17a. In this state, only instruction "2" is monitored for a 
forwarding situaticm. Instruction "I" cannot forward with instruction "3" because they cannot concurrently be 
in the EX stage. Instruction "3" cannot have a RAW dependency on instruction "4" because instruction "4" Is 
junior to instructton "3" (although, as shown in Figure 17a. instructton "4" can have a RAW dependency on 
instruction "3"). 

A block diagram of the forwaitJing control circuitry is shown in Figure 18. The circuitry of the forwarding 
control stage is associated with the AC2 stage. The forwarding control circuitry 300 includes operand monitor 
and control circuitry 302 to monitor the source operands of the instructions in the AC2 pipe stage and the 
source and destination operands of the instructions in the EX stage and to modify the residual control infor- 
mation as described above. Further, once the possibility of a forwarding situation is detected, instruction move- 
ment monitoring circuitry 304 of the forwarding control circuitry 300 monitors movements of the instructions 
to detect the presence of both instructions in the respective EX units to implement forwarding. Control circuitry 
306 coordinates the operand monitor and control circuitry 302 and instnjction movement monitor circuitry 304. 

In the prefBiTBd embodiment, the forwarding circuitry is part of the register file control found in the physical 
register file (24 in Figure 1a). The register file control also maintains the residual control wwds. 

While forwarding has been discussed in relation to a processor using two instruction pipelines, it could 
be similarly used in connection with any number of pipelines. In this case, theforwaiding control circuitry would 
monitor the residual control words associated with instructions in the EX units of each of the pipelines at the 
EX and AC2 stages. 

Forwarding and register translation are independent of one another. In a given microprocessor, either or 
both techniques can be used to increase instruction throughput 

10. Conclusion 

While the present invention has been described in connection with a specific embodiment of two pipelines 
with specific stages, it should be noted that the invention, as defined by the clai ms, could be used in connection 
with more than two pipelines and different stage configurations. 

The pipe contrd unit disclosed herein provides an efficient flow of instructions through the pipeline, which 
increases the rate at which the instructions are processed. Hence, a higher instruction throughput can be ach- 
ieved without resort to higho- frequencies. Further, the register translatton unit and forwarding eliminate many 
dependencies, thereby reducing the need to stall Instructions. 

Although the Detailed Description of the Invention has been directed to certain exemplary embodiments, 
various modifications of these embodiments, as well as alternative embodiments, will be suggested to those 
siulled in the art For example, while various methods and circuits for pipeline control have been illustrated in 
conjunction with one another, independent use one or more of the various methods and circuits will generally 
lead to beneficial results. 

The inventfon encompasses any modif cations to the described embodiments or alternative embodiments 
that fall within the scope thereof. 
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Claims 

1. A superscalar, pipelined processor with a plurality of execution pipelines each with a plurality of stages 
in which instructions issued into a pipeline are processed, thereby altering processor state, comprising: 

instruction issue means for issuing instructions into multiple pipelines without regard to data de- 
pendencies between such issued instructions; and 

pipeline control nrMans for nx>nitoring data dependencies between instructions in multiple pipe- 
lines; 

the pipeline control means controlling the flow of instructions through the stages of the pipelines 
such that a first Instruction in a current stage of one pipeline Is not delayed due to a data dependency on 
a second instruction in another pipeline unless such data dependency must be resolved for proper proc- 
essing of the first instruction in such current stage. 

2. The processor of Claim 1 wherein the data dependencies to be resolved include read-after-write depend- 
encies in which a first instruction in a first pipeline must write results to a register before a second in- 
struction in a second pipeline can read such result data from that register. 

3. The processor of Claim 1 or 2, further comprising register translation means, including register renaming 
means for eliminating write-after-write and write-after-read data dependencies using register renaming. 

4. The processor of Claims 1-3, further comprising data forwarding means for eliminating, for selected in- 
structtons, data dependencies by forwarding an operand or a result from a senior instru(Aion directly to 
a junior instruction. 

5. A superscalar, pipelined processor procesaw with a plurality of execution pipelines each with a plurality 
of stages in which instructions issued into a pipeline are processed, thereby altering processor state, com- 
prising: 

instruction issue means fty issuing instructions into the pipelines; and 

pipe control means for monitoring the relative sequence of instructions in the pipelines, and, for 
each stage of each pipeline in which an instrucUon can cause an exception, monitoring the exception sta- 
tus of an instiuction; 

the pipe meanscontrolling instruction flow in the pipelines such that, for a given stage, a junior in- 
struction cannot modify the processor state before a senior instrucAionuntil after the senior instruction 
can no longer cause an exception. 

6. A superscalar, pipelined processor with a plurality of execution pipelines each with a plurality of stages 
in which tnstructtons issued into a pipeline are processed, thereby altering processor stale, comprising: 

instruction issue means for Issuing instructions into the pipelines; and 
pipe control means, including pipe switching means for selectively switching instructions between 
pipelines; 

the pipe switching means ordering instructions in the pipelines so as to reduce dependencies be- 
tween instructions. 

7. A superscalar, pipelined processw with a plurality of execution pipelines each with a plurality of stages, 
including an execution stage, in which Instructions issued into a pipeline are processed, thereby altering 
processor state, comprising: 

instruction issuing means 1(x issuing instructions into the pipelines; 

for selected instructions, the instruction issue means issuing a single instruction into at least two 
pipelines 

microcontrol means for providing independent microinstruction flows to respective execution sta- 
ges of the pipelines; 

for each such selected instructions, the microcontrol means selectively controlling the flow of mi- 
croinstructions to the execution stages of the at least hwo pipelines such that these execution stages are 
independently contndted to process the selectedi instruction. 

8. A superscalar, pipelined processor with a plurality of execution pipelines each with a plurality of stages 
in which Instructions issued into a pipeline are processed, thereby altering processor state.comprising: 

instruction issue means for issuing instructions into Uie pipelines; and 

pipe control nteans for monitoring, for each pipeline, state information for each stage; 
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for each pip^ine. the pipe control means controlling the flow of Instructions between stages re- 
sponsive to processor state information, such that an Instruction is allowed to advance from one stage 
to another independent of the movement of other inslnictlons in corresponding stages of other pipelines. 

». Asuperscalar. superpip^ined jMocessor with a plurality of execution pipelines each with a plurality of sta- 
ges in which instructions issued Into a pipeline are processed, thereby altering processor state, compris- 
ing: 

instruction issue means tor Issuing instructions into the pipelines, including f^t and second in- 
structions; 

pipe control means for detecting any dependencies between the first and second instructions; and 
register translation means responsive to detection of an instruiAlon dependency by the pipe control 
means for modifying an operand source for one of the first and second instructions to eliminate a de- 
pendency between suchinstructions. 

10. A pipelined processor having an execution pipeline with a plurality of stages in which instructions issued 
into a pipeline are processed, thereby altering processor state, the Instructions referencing a defined set 
of logical registers.comprising: 

a register file including a plurality of physical registws in excess of the number of logical registers; 

register translatton means for allocating physical registers to logical registers, and for each physical 
register, storing an indication of whethersuch physical register holds the cunrent value of the correspond- 
ing logical registen 

in response to an instruction that wiftes a resultto a destination logical register register, the register 
translation means allocating a new physical register to such destination logical register, and designates 
such that the new physical register as current for sudi destination logical register 

checkpointing means for checkpointing state information defining a set of physical registers that 
have been most recently allocated to each of the logical registers prior to allocating a physical register, 
and associating such checkpolnted state information with a cun-ent stage for the instruction causing the 
allocatton; and 

exception handling means for restoring such checkpolnted state information responsive to an ex- 
ception caused by the instruction causing the allocation. 

11. A pipelined processor having an execution pipeline with a plurality of stages in which instructions issued 
into a pipeline are processed, thereby altering processor state, the instructions referencing a defined set 
of logical regtstere having multiple addressable sizes as sources and destinations of operands for the in- 
struction.comprising: 

a register file induding a plurality of physical registers in excess of the number of logical registers; 

and 

register translation means for selectively allocating one of said physical registers to one of said log- 
ical registers responsive to an instruction for writing to said one of said logical registers and the size as- 
sociated with the logical register. 

1 2. A pipelined processor having an execution lapeline with a plural Hy of stages in which instructions issued 
into a pipeline are processed, thereby altering processor state, the instructions referencing a defined set 
of logical registers having multiple addressable sizes as sources and destinations of operands for the in- 
struction, comprising: 

a register file with a plurality of physical registers in excess of the number of logical registers; 

scoreboard means for assodating with each physical register a indication of whether it is a cuaent 
register, and a a logical ID code identifying the logical register to which the physical register is allocated; 
and 

register translation means for receiving a logical ID code for a requested logical register and com- 
paring the received logical ID code to the logical ID code stored in the second memory; 

the register translation means outputting a physical ID code if said received logical ID code corre- 
sponds to the logical ID code stored in said second memory and if said first memory Indicates that the 
physical register is a current register. 

13. A pipelined processor having an execution pipeline with a plurality of stages in which instructions Issued 
into a pipeline are processed, thereby altering processor state, the Instructions referendng a defined set 
of logical registers having multiple addressable sizes as sources and destlnattons of operands for the In- 
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struction.comprising: 

a register file with a plurality of physical registers in excess of the number of logical registers; 
register translation means for generating signads for respective logical registers indicating whether 
a data dependency exists for that togical register. 

14. A pipelined processor having an execution pipeline with a piurality of stages in which instructions issued 
into a pipeline are processed, thereby sdtering processor state, the instructions referencing a defined set 
of logical registers having multiple addressable sizes as sources and destinations of operands for the in- 
structbn, comprising: 

microcontrol means for providing, for each instruction, a sequence of microinstructions controlling 
execution of the instructions in an execution stage of the executbn pipeline; 

a register file with a plurality of physical registers for storing information associated with the logical 
registers; and 

register translation nrwans for allocating physical registers to the logical registers; and 
for selected instructions, the register translation means being enabled to be controlled by micro- 
instructions from the microcontrol means. 
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